Self-organized criticality in glassy spin systems requires long-range interactions 
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We investigate the conditions required for general spin systems with frustration and disorder to 
display self-organized criticality, a property which so far has been established only for the infinite- 
range Sherrington-Kirkpatrick Ising spin-glass model [Phys. Rev. Lett. 83, 1034 (1999)]. Here we 
study both avalanche and magnetization jump distributions triggered by an external magnetic field, 
as well as internal field distributions in the short-range Edwards- Anderson Ising spin glass for various 
space dimensions between 2 and 8. Our numerical results, obtained on systems of unprecedented 
size, demonstrate that self-organized criticality is recovered only in the strict limit of infinite space 
dimensions (or equivalently of long- ranged interactions), and is not a generic property of spin-glass 
models in finite space dimensions. 
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Self-organized criticality (SOC) refers to the tendency 
of large dissipative systems to drive themselves into a 
scale-invariant critical state without any special tuning 
of the parameters These phenomena are of cru- 

cial importance, because fractal objects displaying SOC 
are found everywhere 0]: one encounters them in earth- 
quakes, in the structure of dried-out river beds, the me- 
andering of sea coasts, or in the structure of galactic clus- 
ters. Understanding its origin, however, represents a ma- 
jor unresolved puzzle of modern science, because in most 
equilibrium systems critical behavior featuring scale-free 
(fractal) patterns is found only at isolated critical points, 
and is not a generic feature across phase diagrams. 

Pioneering work in the 1980s provided important in- 
sights into the possible origin of SOC by identifying few 
theoretical examples that display it. The sand-pile model 
Q and the forest-fire model Q are hallmark examples 
of dynamical systems that exhibit SOC. However, these 
models feature ad hoc dynamical rules, without showing 
how these can be obtained from an underlying Hamilto- 
nian dynamics. Major questions thus remain: First, can 
one obtain SOC from an underlying Hamiltonian model? 
Second, is this behavior a feature of high-dimensional 
models or models with long-range interactions, or is it a 
generic property of broad class of systems? 

However, work in the 1990s offered a glint of hope. The 
first Hamiltonian model displaying SOC without the tun- 
ing of any parameters was identified and studied in detail 
in the pioneering work of Pazmandi et al. [|| . Here, the 
infinite-ranged Sherrington-Kirkpatrick (SK) spin-glass 
model Q was examined; out-of-equilibrium avalanches at 
zero temperature (T = 0) triggered by varying the mag- 
netic field were numerically studied along the hysteresis 
loop. A distinct power-law behavior in the distribution 
of spin avalanches, as well as of the magnetization jumps 



was established, i.e., SOC. 

The possible existence of SOC was also tested in several 
finite-dimensional models, but in all these cases at least 
one parameter has to be tuned for the system to display 
scale-free avalanches. The best-studied such model is the 
random-field Ising model where ferromagnetic Ising spins 
are coupled to a random field of average strength R. For 
space dimensions d larger than two, a critical value R c 
exists where avalanches and magnetization jumps along a 
hysteresis loop show signs of criticality, i.e., the relevant 
distributions assume a power- law form @"U|- We stress 
that in this model, tuning of the parameter R is needed; 
only at R = R c scale-free avalanches occur. Similar re- 
sults were found for the random-bond Ising model [l2| 
where spins interact with bonds Jy drawn from a Nor- 
mal distribution with a ferromagnetic mean unity and 
standard deviation a. For a critical value of o~ c ~ 0.44 
signs of criticality are found. Finally, studies on the ran- 
dom anisotropy Ising model [HI also showed a similar 
behavior when a the system is tuned to criticality. 

Surprisingly, no numerical studies have been reported 
to date for the "vanilla" Edwards-Anderson Ising spin 
glass (EASG) [l4| (Normal-distributed random interac- 
tions with zero mean). Recently, Le Doussal et al. (l5| 
suggested the possibility of SOC in the EASG for finite 
space dimensions. Their calculation is based on droplet 
arguments and suggests that at least for fields close to 
zero SOC should be present when studying avalanches 
in the EASG. Although their considerations are done for 
systems in equilibrium, their results suggest that SOC 
might be present in out-of-equilibrium avalanche simula- 
tions as done for the SK model in Ref. 

A deeper understanding of models that exhibit SOC 
is thus needed. Because the SK model is thought to be 
the mean-field limit of the EASG, standard lore would 
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suggest that the short-range EASG may display SOC 
for all space dimensions d > 6, i.e., above the up- 
per critical dimension d u where mean-field behavior sets 
in. To understand whether mean-field behavior suffices, 
or truly long/infinite-range interactions are needed, we 
study field-driven avalanche distributions at zero tem- 
perature for the EASG in d = 2, 3, 4, 6, and 8 space 
dimensions. Therefore, we probe the system below, at, 
and above the (equilibrium) upper critical dimension. In 
addition, we compare to results for d = oo, i.e., the SK 
model. Our results, obtained for extremely large system 
sizes, demonstrate that as long as the space dimension 
d < oo no SOC is present in the EASG. However, for 
d = oo (SK model), SOC is recovered. Our results there- 
fore indicate that long-range interactions represent the 
key ingredient to obtain parameter-free avalanches and 
SOC in spin systems. 

Model, Observables and Algorithm. — We study 
glassy Ising models in d space dimensions with the Hamil- 
tonian 
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Here Si = ±1 represent N — L Ising spins on a hypercu- 
bic lattice of linear size L. The interactions Jjy between 
the spins are drawn from a Normal distribution with zero 
mean, and H represents an external magnetic field used 
to drive the avalanches. For d = oo, i.e., the SK spin 
glass Q , the sum is over all spins and the variance of the 
spin-spin interactions is chosen as 1/(N — 1) to ensure 
extensive quantities. When d < oo the model is known 
as the Edwards- Anderson Ising spin glass Q j where the 
interactions arc limited to nearest neighbors and have 
variance unity. 

The numerical method used is zero-temperature 
Glauber dynamics, which has been successfully used be- 
fore 0, S Gil ■ We start by computing the local fields for 
all spins: hi — ^2,j J^jSj—H. A spin is unstable if the sta- 
bility hiSi < 0. The initial field H is selected to be larger 
than the largest local field, i.e., H > \hi \ Wi. The spins are 
then sorted by local fields and the field H reduced until 
the stability of the first sorted spins crosses zero, mak- 
ing the spin unstable [l7[- This unstable spin is flipped, 
then the local fields/stabilities of the other spins are re- 
calculated, and the most unstable spin is flipped again. 
The process is repeated until all spins become stable, i.e., 
their stabilities are nonnegativc. In most cases, the flip- 
ping of the first unstable spin triggers the flipping of a 
substantial number of other spins, therefore causing an 
avalanche. A focus of the present paper is to characterize 
the statistics of these avalanches. Simulation parameters 
are shown in Table HI 

At each avalanche triggered by the above algorithm, 
we measure the number of spins n that flipped until the 
system regains equilibrium and record the distribution 



TABLE I: Parameters of the simulation: For each space di- 
mension d we study systems of N = L d spins (d < oo) and 
compute the different distributions over JV sa disorder samples. 
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N 


N sa 


2 


1000 


1 000 000 


15 000 
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2000 


4 000 000 


15 000 


2 


3000 


9 000 000 


14 880 


2 


4000 


16 000 000 


14 860 
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100 


1 000 000 


15 000 
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150 


3 375 000 
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3 


200 


8 000 000 


12 900 


3 


250 


15 625 000 


14 250 


4 


10 


10 000 


15 000 
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20 


160 000 


15 000 
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40 


2 560 000 


15 000 
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(ill 


12 960 000 


15 000 
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262 144 


15 000 
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10 


1 000 000 


15 000 
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12 


2 985 984 


15 000 
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14 


7 529 536 


15 000 
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16 


16 777 216 


15 000 
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65 536 


15 000 
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390 625 


15 000 
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1679 616 


15 000 
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5 764 801 


14 480 
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16 777 216 


10 200 


oo 


N/A 


2 500 


100 000 


oo 


N/A 


5 000 


19 800 


oo 


N/A 


10 000 


14 900 


oo 


N/A 


20 000 


14 860 


oo 


N/A 


30 000 


19 795 



of avalanche sizes D(n) for all triggered avalanches until 
Si — > —Si Vi. In addition, we measure the magnetization 
jump S at each avalanche and record the distribution 
of magnetization jumps P(S) [HI- For the SK model 
the avalanches are expected to be power-law distributed 
with an exponential cutoff that sets in at a characteristic 
size n* (similar arguments are valid for the magnetization 
jumps with a characteristic size S*). Only if n*(N) — > oo 
as N — > oo does the system exhibit true SOC. We deter- 
mine n* in two different ways: First, we fit the tail of 
the distributions to D(n) ~ exp [— n/n*(N)} with n*(N) 
an fitting parameter. We also fit the small-n regime to a 
power-law and determine the point of closest proximity 
between the power-law and exponential cutoff fits. This 
yields a second estimate of n*(N). While the n*(N) val- 
ues obtained by the two approaches can differ by as much 
as a factor of ~ 2, n*(N — > oo) obtained by either def- 
inition exhibits the same qualitative behavior. In the 
simulations we fit the distributions and extract n*(N) 
for a given space dimension d and (linearly) extrapolate 
to N = oo. 

In addition, to study criticality for H ~ in the short- 
range systems, we measure the avalanche distribution 
Do(n) and magnetization jump distribution Pq(S) if and 
only if the field H crosses zero. These measurements 
are necessary for short-range systems because the exis- 
tence of a spin-glass state in a field remains controversial 
Therefore, by restricting the measurements to 
H = we expect to probe an actual (non-equilibrium) 
spin-glass state. 



3 





i(r 2 


\_ 1 1 


re* = 5.60(4) 




10- 4 




^\ h JV = 100 3 - 






k q N — 150 3 


5 


IO -6 




\ a .V 200 3 - 




K)- 8 




m v N = 250 3 




lO" 10 


(a) 






10° 10 1 


10 2 10 3 








n 





IO" 2 




5* = 7.76(3) 




ur 4 






ST 








- o. 


io- 6 








io- s 








io- 10 


(b) 





10° 10 1 



10 

s 



FIG. 1: (Color online) (a) Avalanche distribution D(n) for 
the Edwards- Anderson spin-glass model in d = 3 recorded 
across the whole hysteresis loop, (b) Magnetization jump 
distribution P(S) recorded across the whole hysteresis loop. 
For both quantities, the data show no finite-size effects. The 
solid line represents a power-law fit, whereas the dashed curve 
represents an exponential fit (see text). The vertical (black) 
dashed line marks the crossover value where a power-law be- 
havior changes into an exponential cutoff (n* and S* are de- 
termined by a fit to an exponential cutoff function, see text). 



Ref. [H| argued that a true SOC system suppresses 
avalanche formation and stabilizes itself by develop- 
ing a power-law pseudo-gap in P(h), the distribution 
of stabilities, similar to the Efros-Shklovski gap of the 
Coulomb glass. Requiring the system to be stable against 
avalanches gives stringent bounds on the exponent and 
the coefficient of the power-law form. Therefore, we also 
study the distribution of local fields (stabilities) P(h) for 
h close to zero. 

Results. — Figure Q] shows data for the avalanche size 
and magnetization jump distributions for the Edwards- 
Anderson spin glass in three space dimensions (d = 3). 
The data show that avalanches remains small, even for 
systems with millions of spins, i.e., the cutoffs n* and S* 
do not scale with the system size, fn fact, even though 
we simulate over 10 spins, the largest avalanches (which 
occur extremely rarely) are only of approximately 100 
spins. A crossover from a power-law to an exponential 
cutoff in the distributions occurs for rather small values 
of n and S, respectively, suggesting no SOC. The verti- 
cal dashed line in Fig. [T] corresponds to the extrapolated 
crossover values for n* and 5*, respectively. 

Reference [l| reported that the SK model — typically 
viewed as the mean-field limit/formulation of the EA 
model — exhibits SOC. Therefore, one could expect that 
the EA model exhibits SOC above its upper critical di- 
mension d u = 6. To test this expectation, we simu- 
late systems in d = 8 space dimensions. Again, no vis- 
ible system-size dependence or power-law behavior are 
present, indicating that the system displays no SOC. To 
sidestep the debate over the existence of a spin-glass state 
in a field, we measure the avalanches only when H crosses 
zero, i.e., where it is most probable that the system is 
in a spin-glass state, even if a nonequilibrium-type of 
spin-glass state [H| . Because fluctuations are large when 
the restricted magnetization is measured the data are 
noisy. However, again no large avalanches or magnetiza- 
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FIG. 2: (Color online) (a) Avalanche distribution D(n) for 
the Edwards- Anderson spin-glass model in d = 8 recorded 
across the whole hysteresis loop, (b) Magnetization jump dis- 
tribution P(S) recorded across the whole hysteresis loop, (c) 
Avalanche distribution Do(n) restricted to H = 0. (d) Mag- 
netization jump distribution Po(S) restricted to H = 0. As in 
Fig- \H the data show no finite-size effects. The solid line rep- 
resents a power-law fit, whereas the dashed curve represents 
an exponential fit (see text). The vertical (black) dashed lines 
mark the crossover value where a power-law behavior changes 
into an exponential cutoff (n* and S* are determined by a fit 
to this exponential cutoff, see text). Panels have matching 
vertical and horizontal scales. 
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FIG. 3: (Color online) (a) Avalanche distribution D(n) for the 
SK model recorded across the whole hysteresis loop, (b) Mag- 
netization jump distribution P(S) recorded across the whole 
hysteresis loop. The crossover from power-law to an expo- 
nential cutoff behavior grows noticeably with the system size 
signaling that in the thermodynamic limit the system displays 
SOC. 



tion jumps are visible. 

In contrast, Fig. [3] shows data for the SK model. The 
data are in agreement with the simulation results by 
Pazmandi et al. @: The distribution D{n) [P{S]] has 
a power-law behavior for small n [S] with a crossover 
size n*(N) [S*(N)] that diverges with increasing system 
size. A scaling collapse of the data (not shown) agrees 
with the estimates of Ref. Q . Furthermore, we find that 
1/n* = 0.00011(8) compatible with zero for N — > oo in 
the SK model, i.e., n* = oo. 

To further corroborate our results, in Fig. |4] we plot 
the crossover avalanche size n* as a function of the space 
dimension d for space dimensions d = 2 to 8, as well as 
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FIG. 4: (Color online) Inverse of the characteristic avalanche 
scale n* as a function of space dimension d. The data extrap- 
olate perfectly to the SK limit, meaning that for any finite 
space dimension the avalanches are finite in size. This means 
that SOC is a property of the infinite-ranged model only. The 
inset show P(h = 0) as a function of <f -1 ' 2 for different space 
dimensions. Again, P(h = 0) = only for the SK model 
(data from Ref. JH). 



d = oo (SK). The data clearly show that n* oc d 2 , i.e., a 
true power-law behavior without a cutoff is only feasible 
for d = oo [25|. Note that the same behavior is obtained 
for avalanches restricted to H = 0, as well as the mag- 
netization jumps (not shown), however with large fluctu- 
ations in the data. Finally, our results arc independent 
of the choice of n* (either from a fit to an exponential 
or from the closest distance between the fitting function), 
illustrating the robustness of the effect. We also compare 
our results to that of the pseudogap of the distribution of 
local fields P(h), another quantity found to reflect SOC 
in the SK model [2^. The inset of Fig. H shows P(h = 0) 
as a function of the space dimension. The data clearly 
show that P{h = 0) oc d~ x / 2 — > for d — > 00 only. 

Conclusions. — We have demonstrated that, for large 
system sizes, avalanches in short-range spin glasses do 
not span the system size, even if the space dimension d 
is above the upper critical dimension d u — 6. This sug- 
gests that self-organized criticality as found in Ref. [B[ is 
not necessarily a property of the mean-field regime, but 
is instead a result of long-range interactions. In princi- 
ple, mean-field behavior can be reached in two equivalent 
ways: Either by increasing the space dimension above 
the upper critical dimension or by making the interac- 
tions infinite-ranged. Here we show that these two limits 
can lead to different behaviors, which become equivalent 
only in the d = 00 and of infinite-range interaction limit. 
Analyzing models that allow for a continuous tuning of 
an effective space dimension 27 - 3(J might thus also help 
in gaining further insights into this problem. 

One has to keep in mind, however, that the conven- 
tional arguments 2f| determining the upper critical di- 
mension are restricted to equilibrium states - which be- 
low the glass transition temperature are typically very 



difficult or impossible to reach in any experiment. In con- 
trast, the metastable states that the system visits on the 
outer hysteresis loop — which our avalanches explore — are 
indeed as far from equilibrium as possible. One should, 
therefore, not naively and indiscriminately apply equilib- 
rium concepts such as the existence of the upper critical 
dimension d u = 6 to the far-from-equilibrium behavior 
we study in this letter. This might explain the disagree- 
ment with the results of Ref. [15[ that suggest system- 
spanning avalanches for short-range spin glasses. 

Our finding that the behavior of short-range mod- 
els in any finite dimension remains fundamentally dif- 
ferent than that of the infinite-range model is, there- 
fore, a striking and a potentially far-reaching result. It 
calls for a change of perspective with respect to far-from- 
equilibrium states, and we hope that it will stimulate 
further serious efforts from the theoretical, but also the 
experimental community. The special role we suggest for 
the long-range interactions may have further interesting 
consequences, especially for bad metals near the metal- 
insulator transition [311 ] . Here the Coulomb interaction 
between charge carriers assumes center stage, because 
poor screening in the bad metal regime directly reveals its 



long range nature [32j, [33J . Existing work has already es- 
tablished that the single-particle density of states, which 
represents the direct analogue of the P(h) distribution 
we studied in this paper, opens a power-law "Efros- 
Shklovskii" gap within the Coulomb glass phase 32. 33j| . 



Given our result that vanishing of P(0) is a very direct 
manifestation of the SOC behavior, our findings strongly 
suggest that in the presence of frustrating long-range 
Coulomb interactions, SOC may survive [34J, l35| even 
in physically-relevant space dimensions, such as d = 2 
and 3. Further insights could also be gained by study- 
ing the existence of SOC for one-dimensional long-range 
spin glasses with power-law interactions (27l - [30j where an 
effective space dimension can be tuned. 
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